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ABSTRACT 

The Maryland State Department of Education 
participated with the Cooperative Accountability Project (CAP) in an 
exploratory study of the cost-pricing of educational accountability 
components. The exploratory study was undertaken to determine the 
state of the art in cost-pricing of accountability components at the 
State and local educational levels and to enable the organizations to 
make recommendations about necessary, future research in this field. 
Four educational accountability components were identified: goal 
development and implementation, objective development and 
implementation, status surveying of student achievement, and program 
development. Based on these components, a survey instrument was 
constructed to obtain information from local school systems about the 
costs involved in actually providing information to decisionmakers. 
The basic conclusion reached in the survey is that smaller school 
systems will require additional financial aid and technical 
assistance in establishing a comprehensive accountability program. 
(Author/WH) 
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CHAPTER I 
INTRODUCTION 



Scope of the Study 

This study was initiated with the objective of developing and improving educational accountability 
cost measures, both within local school systems and for entire states, Attempts to quantify account- 
ability may be traced to the early 1960s when both the Department of Defense and the Bureau of the 
Budget began advocating Program Planning-and-Budgeting Systems (PPBS). PPBS refers to the 
attempt to develop procedures for specifying goals and objectives and for evaluating alternatives 
considered in terms of social benefits and costs. 

As one of the participating states in the Cooperative Accountability Project (CAP), Maryland agreed 
to sponsor an exploratory study designed to delineate the costs and develop the materials to imple- 
ment a component cost study for a comprehensive educational accountability program. It was 
recognized that the traditional information collected and disseminated by state departments of 
education reflects imperfectly the various cost issues that are to be analyzed in an effective account- 
ability effort. 

Accountability initiative originated within the administrative sections of government, and recent 
legislative mandates also are directed toward similar ends.Rising school costs and taxes give impetus 
to public insistence for evaluation of educational programs, public dissemination of evaluation 
results, and corrective action based on those results. The National Assessment of Educational Prog- 
ress (NAEP), the 1965 ESEA Title I project with its focus on educationally and culturally deprived 
children, and the 1966 Coleman Report on Equality of Educational Opportunity ^ also contributed 
significantly to the accountaoility movement and to renewed emphasis on measuring student 
achievement. 

The Maryland State Department of Education (MSDE) was called upon to conduct an exploratory 
study to estimate the costs of the educational components within a comprehensive accountability 
program. The general purpose of th is study is to determine the state-of-the-art in estimating the cost of 
accountability components as they currently exist in the state of Maryland and to recommend exten- 
sions of the component cost system to other states. 

More specifically, the Cosfs of Educational Accountability exploratory study jn Maryland is intended 
to make available to MSDE and CAP accountability cost information which has the greatest possible 
utility in so far as it is related to four Maryland accountability components identified as: 

1. Educational goal development and implementation 

2, Objective development and implementation 

3. Status surveying cf activities associated with assessment of student performance, 
competency, and achievement levels 

4, Program development 

Background of the Study 

In order to understand the results of this exploratory study, some background information is 
required concerning the Maryland educational system. There are 24 school systems in the state, one 
for each of 23 counties plus one for the city of Baltimore. 



' James S Coleman and oHiers. Equality of Educational Opportunity (Washington. D.C.: U.S. Department of Health, Education, 
and Welfare, Office of Education. 1966) 
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These school systems range from thore located in highly urbanized areas which are concentrated in 
the Boston -Washington corridor of the eastern megalopolis, to those found in the rural, 
agrarian - based communities of the Eastern Shore and areas of western Maryland in Appalachia, 
Thus it can be seen that tremendous heterogeneity exists among the 24 school systems. Such variety 
tends to render this study more interesting, for the closer Maryland is to being a microcosm of the 
nation, the mere relevant will be the generalizations which may accrue from the study. 

Table 1.1 describes the numbers a.iJ types of schools which existed in each of Maryland's school 
systems in September, 1970. The diversity in local school systems is apparent. Note the two rural 
counties which still have one-teacher elementary schools. Surprisingly, this still occurs in what is 
predominantly a highly urbanized state. 
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Number of Maryland Public Schools: September 30. 1970 



Local Unit 




Grand 
Total 


Elemen- 
tary 
Only 


Secondary Only 


Combined 


Total 


Junior 
(Grades 7-9) 


1 Jr.-Sr. 
(Grades 7-12) 


Senior 
(Grades 9-12) 


Vocdtional- 
Technical 


Total 


Middle 


other 


Total State 


1.306 


943 


291 


119 


46 


110 


1 : — 

16 


72 


I 38 


34 




oo 


97 


8 


2 


3 


2 


1 


3 




3 


r\nnc# MrunutJi 


QQ 


7Q 


19 


10 


1 


7 


1 


1 


1 




Baltimore City 


211 


158 


45 


16 


13 


14 


2 


8 




8 


RAltimnrp 


1 u 


inn 


42 


20 


3 


16 


3 


4 


1 


3 


Calvert 


13 


11 


1 






1 




1 


1 


" 


Carolme 


10 


6 


4 


2 




2 










Carroll 


26 


17 


5 


1 


1 


3 




4 


3 


1 


Cecil 


55 


16 


6 




3 


2 


1 


3 


3 




Charles 


24 


15 


4 






3 


1 


5 


4 


1 


Dorchester 


20 


16 


4 


1 


3 












Frederick 


33 


23 


7 




5 


2 




3 


2 


1 


Garrett 


19 


15 


2 




2 






2 




2 


Harford 


38 


27 


8 


2 


1 


4 


; 


3 


2 


1 


Howard 


29 


18 


5 






4 


1 


6 


6 ' 




Kent 


8 


4 


1 






1 




3 


1 1 


2 


Montgomery 


187 


139 


46 


24 


5 


17 




2 


2 




Prince George's 


226 


169 


57 


36 


3 


17 


1 




. 1 
1 




Queen Anne's 


12 


S 


2 


1 




1 




2 


2 ; 




St. Mary's 


23 


16 


3 






2 


1 


4 1 


3 1 


1 


Somerset 


16 


9 


3 


1 




2 




4 

1 


1 ; 


3 


.'•Jb jX 


13 


10 


2 


1 




1 




1 




1 


V/arhington 


44 


29 


7 




1 


5 


1 


8 


' \ 


2 


Wicomico 


24 


16 


6 


2 


1 


2 


1 


2 i 


" J 


2 


Vvf t'cester 


14 


7 


4 




1 


2 


1 1 
1 


3 i 
1 


1 

1 


3 



'Includes following one-teacher schools; Garrett. 1: Somerset. 1. 



Source Maryland State Board of Education. 105th Annual Report: A Statistical Review for the Year Ending June 30, 1971 
Dfipartment of Education. Table 3. 
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Table 1 .2 describes the composition of the professic*^' « school staffs, by county. The varying pro- 
portions of different categories of professional specialties imply differing goals and objectives among 
school systems. Cost information concerning their differing goals and objectives is pertinent to a 
variety of school systems elsewhere in the United Stales. 

Not only do Maryland school systems differ widely across the state in terms of enrollment, number of 
schools, and staff, but they also vary in terms of per-pupil expenditures. These per-pupil expenditures 
obviously are a result of the school district's general and relative socioeconomic status. The simple 
correlation between measures of an area's economic status, in terms of either per capita income or 
median family income, and pei -pupil expenditures, is in the neighborhood of .70 as would be expect* 
ed a priori. Thus the relative economic status of a school system also is an important variable which 
should be analyzed with respect to its effects on the establishment of goals and objectives. 

Table 1.3 illustrates the per*pupil expenditures for each of the 24 school systems. The wealthiest 
county. Montgomery, has the highest per-pupil expenditures while the county with the lowest per 
capita income. Somerset, spends the least on the average student. 

Table 1 .4 shows the sources of revenues in each of the school systems. Large variation exists here 
too in the percentage derived from each of the three major sources of financing: local, state, and 
federal. While some systems are better able to finance their educational systems locally, other areas 
appear better able to find and tap external funding sources. Thus the per-pupil expenditures must be 
interpreted in light of both the school system's ability to finance the system and the absolute size of the 
system. The analysis which follows, therefore, will be undertaken both in terms of size of the school 
system as measured by enrollment and in terms of the system's income levels. 

Maryland Educational Accountability Act 

A brief review of the Educational Accountability Act that exists in the stateof Maryland will conclude 
this background discussion. The Act is reprinted in Figure 1.2. 



FIGURE 1.2 



Article 77. S. 28 A, reproduced below, was passed in the 1972 legislative session of the Maryland State 
Legislature. The bill provides for a program of educational accountability for the public schools of 
Maryland. Members of the State Department of Education worked with legislators on this bill. 
Although the bill was to take effect July 1, 1972, funding was not provided until July 7, 7973. 



ARTICLE 77. SECTION 28A 
(Senate Bill No. 166) 

The purposes of this Act are to provide for the establishment of educational accountability in the 
public education system of Maryland, to assure that educational programs operated in the public 
schools of Maryland lead to the attainment of established objectives for education, to provide infor- 
mation for accurate analysis of the costs associated with public education programs, and to provide 
information for an analysis of the differential effectiveness of instructional programs... 

(a) Educational accountability program. The State Board of Education and StateSuperintendent of 
Schools, each Board of Education and every school system, and every school, shall implement a 
program of education accountability for ihe operation and management of the public schools, 
which shall include the following: 

(1) The State Board of Education and the State Superintendent of Schools shall assist each 
local school board and school system in developing and implementing educational goair 
and objectives for subject areas including, but not limited to. reading, writing^ and 
mathematics. 



5 



cri 

1 



n 

Q. 

C 

m 

cvi 



c 

CO ^ 
t- c 

u. 



LU 

ffi 
< 



.SS c 
.E .2 
E 

< 



J) o c 
u « 

•I Ss: 
2 ="5 



1? 



Si u 

S'E 



O (0 



C 

O 



C 

c 
o 



a 

3 
Q. 

I 

CO 

O 

O 



o 

3 C 

^ .9 

OS 

c 



_ S 8 .5 J, 

O ^ X ^ CO 
»^ o ^ 



= « A 

& c r* 

3 S? - 



^ m O) C 

- c 2 c g 



i a^ 

o5 g 



2 C 
H O 
Q. 



1 



n oi %n q6 ONiiopoi ^^irico 

CMCM«-f-CM il5i>Jf-Cgf- CMCMf-f- 



8 

CO 



oco^oor^ h»cj>^<o(0 o^ioooip cpcNv-m^ a><p^^ 

T-T-CNjT-rt T-T-CJCNJCM 



^ oi ^ 

OJ CM f- W CM 



Sf-^cNh« €oa>o>(QQ S!990>QCM q>iog>cnio 
^inino> <o^^ouS CMor^^cM cor^^pr^ 



a> ^ 00 
00 00 in 9 



^ c>ia><d^<p di^cotpo) coa><oa>a> eocMi^inV sp^i^O) 

CO CM*-9>COo3 ^CMCNiNCQ CNf-CO^W COCOCNCNCN CMCM*-f- 



CO CMCMlOkOQ OCMCMOOO riSOiQlQ COj-if-QCO iQ^SSS^f 

^ olfpeqq? i^iooqN.cN cq'^r^odin lON-cpoooi <p^coo> 
rS r^irjSSSi SSSo^S ^^Sc^^ SS^S^ SSinS) 



SifiSSS S^3$^ ^^SSS^ ^IS^S 

CMCOCM cMO^cioi oicdoidoi ocooi^tf) ^^oi^ 



g ^ o j2 ^ 



^ CM S ^ 

<d ifi 1^ 1^ ^ 



Q ^ 00 ^ 
CO ^ 1^ ^ 

CO ^ in oi 



« »- r*. CO <p 
^ r r ® 
CO 00 ^ d ih 



S CM S S 
CO iri CM oi 



SA m CO 
Ok ^ CM 



f- o» in in CD 
CM in ^ Ok 



SCM CM O 
CO 00 CO 



inSIn S^^^S ^SsS? §SSIS 



» «!e3SS 8:889 ^ssss s&ss 

§ gs^ii uut uun sMU mu 



CM 
CO 



3 CO a ^ 

CO r«» CO Oj 



flo CM CO 
CO flO Ok o> in 



^ Sc^^^o SSSSS ^^ScoS 



CM ^ m 00 CO 

^ CM 00 

CO S S rS S 



Ok CO CO uS 
m ? CO oo 



00 GO GO 



S3p8^ cmS$^S inSp^ 
h^r^r^GOflO p5r^h«co oo 



CO 



■o 
c 



a « 

o ^ 



05.^ 
" O 

3 c> Ok _ S ^ 

craqca co«ooi=o Snnoo 

<mmo ooooo £0x1^ 



£« ? 



$ 8 c « « 
S 0< > 9 



1 

o£ 1 

2 a: O 



o 
E 
o 



O n >- 
€) 8 S 



ll 

O 

80 C 
Ok 

c ^ 
CO ^ 

5 1 



0) CO 

i s 

3 9> 



i £ 

X CG 

8 • 



a CO 

II 

,2 .. 

T O O 



I 



6 



ill 
-J 

CD 
< 



o w 
S 



IB ^ 

5 ^ 



0) u 
10 O 

£ ^ 

X E 
UJ ^ 

c c 

SI 

a ^ 



CO 



< 10 

(A ~ 
Q. 



8 



O 
10 
UJ 

E 
o 



c 



O 0) 



CO 



0) 



CO 



o 

3 
C 
O 
> 

o 

c 
o 
z 



o 

C 

s 

o 



o 

a 
a 
< 



i2! 



0) 

CO 

cn 



to 

CO ^ 
P o 



f- CO 

d 



^ (0 CM CO CO ^ 

odd 



I C9 

d 



c> CO CO CO CO 
d d d 



CO CO ^ 
d 



r9 inpopiOO) c»30>CM^cp ^opopcooo in^h.coi-^ tropin 

S^inddo r2c>ia)inco dsP9^^ oidd^r^ oocoinco 
inm^co^ coin^^^ inoj^<DU) coouScmcm Sin^in 



p p 

00 00 00 ^ CO CVJ 



p ^ oj q A 
«n uS rti ^ ^ 



00 p 0> O 

m d CO c*^ 



cvjCMiOooA CM V- O) 00 

cfi (^fl6N<d CsiOKO) 
^ CM ^ ^ ^ 



p^oq^co r^in(po>CM ppincooi p^opcTip r^p^-p 

S cM^^Sin ^(8^^ 



^ in 

OQ 



9 ^ C> 

» CO " 



in 

CM 



c9 o S in c\i 

CM Si CO 

p p CQ p CO. 

^" CM ^ CO" 
CM 



IP 

CM 
CO 



CM 

cm" 



O «- Oi o> 
V- ^ in 



in to Q 
in o> CO ^ CO ^ 00 CM 



CO in 



in 



(o ^ A CO in 

CM 0> *- h. 

CO ^ ^ CM h- 

so ® in CM 

in o Q ^ 

^ ^ CO 



p 55 ^. 



CO 



CM *- t- fN. 



CM 0> 

in 



d ir d r^* 

CO ^ 0> CM 



00 00 ^ 
in CM V- 
a> IT 



CVi p 

^ o 



h. CM ^ 

d 



Oi 
CM 
P 

GO 



CO CO CO V- in 

^ O CO ^ 

p CM in p 

^* CM CO' CO CO O CO CM CO CO C>l Q 00 

^S;::!;;; S^^^^S S!^S>^Si 



CM in 

CO ^ 
CM CM 



00 g 



SCO f- CO CO 



CM ^co^incM a»-^o^ 



00 



CM 



O) CO O CM 

SfN. f- (0 

rs. CO rs. 

CM* d ^' CM* 



CO 
CM 



CM ^ in CO 

ffi CO o> in ^ 

w h- ^ o N- 

^" in CO CO (0 
lO h. 2 CO 

CM p as CO 

r-" in 0> CO* 



CD CM 

P8 



in 



CO CO 9 Q CO 

CD A o in 
m CO oo flo 



o> in 

CO r5 

CM CM 

CM cm" 

Q% 0% ^ 

CO in *- 



P ^^^COO ^Oh-CM 



0> Ci 
CM ^' 



§« f- 
O) ^ CM 



!S 3 S 7) 

CM* 



CO 

in" 

CM 



Is 



CM 00 Q CO 



do in ? 

3 p p r^. p 

iW ^ S 
CM CO CO 



in CM CO c 

r»- in ^ cv 

CM CM o a 

cm" ■ ' " 

Oi in 



00 0> CO CO h» 

SCO ^ 
in h» CO 00 



^ O) Q ^ 

^ CO in f- 

h- CM 



^coooiQ «-]^cpcpr^ ooQ>iOQ*.'' ^cp^co 
CMda>oin cMa>o>SS ^QcmS 
^oo>^ coin^CMv- oo^ino^ (o?cS 



^ ^ CM 



incMC3)in^ <S55'^^'" 



5 ^ CO 
00 CO CO 

d 0( p 
c 

r- in* ^ 



Si 

CO 



in 

00 oo 



CO CO 



^ <» CO in 
*- in h- CM 



o CO o> 
^ Q § h- 
P CO p 

^ in S ? ? 
CM in CO ^ 
'^" cm" Oi CM in" 



r^oeooco oo OO in in 

^^h-inin CMCQCMO>co 

1-^ CM h-^ p p in p p p CO 

d CO d m" in" op r-' r-* co d 

CMin«tcoco r)dkO>^^ 

h-" ^* CO CO CO iQ iO CO* O) CO* 



GO 

^' 5? S 

m CM CO CM 

^ g d m* 



55 

o 
I- 



o .t: 

^ 3 O Q) S 

oc*;^^ LiwucOk: 

= ccocQ<o ca(oa)£0 

<<GDCDO OOOOO 



a ^ TJ p 



0) 0) 



o 5 ^ 

r 5 c 

CO O 0) 

X X ^ 



III 



CO ^ 

2 e 

^ o 



S o 



^ » o 



a O 



9 



oo 



8 



ERIC 



(2) Each school, with the assistance of its local board of education and school system, shall 
survey the current status of student achievement in reading, language, mathematics, and 
other areas in order to assess its needs. 

(3) Each school shall establish as the basis of its assessment project goals and objectives 
which are in keeping with the goals and objectives established by its board of education 
and the State Board of Education. 

(4) Each school, with the assistance of its local board of education, the State Board of 
Education and the State Superintendent of Schools, shall develop programs for meeting its 
needs on the basis of priorities which it shall set. 

(5) Evaluation programs shall concurrently be developed to determine if the goals and 
objectives are being met. 

(6) Re-evaluation of programs, goals and objectives shall be regularly undertaken. 

(b) The State Department of Education shall assist the local boards of education in establishing this 
program by providing guidelines for development and implementation of the program by the 
local boards, and by providing assistance and corrdination where needed and requested by 
those boards. 

(c) Beginning on July 1, 1973, the State Board of Education, upon recommendation of the State 
Superintendent of Schools, shall include in its annual budget request such funds as it deems 
necessary to carry out the provisions of this Act. 

(d) During January, 1975, and each January thereafter, the State Superintendent of Schools shall 
transmit to the Governor and to the General Assembly a report which includes, but is not limited 
to, documentation indicating the progress of the State Department of Education, the local 
boards of education and each school in the State toward the achievement of their respective 
goals and objectives and recommendations for legislation which the State Board of Education 
and the State Superintendent of Schools deem necessary for the improvement ot the quality of 
education in Maryland. 

Sec. 2. And be it further enacted that this Act shall take effect July 1. 19/2. 

The Act requires each local school system to establish goals and objectives and to develop 
evaluation programs to determine the degree of success achieved. The law does not specify how this 
evaluation should be implemented. 

The State Department of Education has prepared a handbook on the Maryland Accountability 
Assessment Program (MAAP) which concentrates on measuring the achievement levels of students 
through the introduction of standardized tests across the state. The handbook says: 

Accountability can be said to exist when the following conditions have been met: (1) the 
state goals of education reflect the educational needs and interests of the population; (2) 
minimum student achievement expectations have been developed in each goal area; (3) 
current student status, recent progress, and needed improvement In each goal area are 
matters of public record and specific objectives for improving the current status have been 
adopted; (4) programs to achieve specific objectives have been implemented and finally, (5) 
the cost of programs, i.e.. the cost of achieving goals and objectives, is a matter of public 
record. 2 

Unfortunately, little attention had been directed toward estimating the costs of implementing MAAP. 
Among the most critical educational accountability issues to be faced, as observed by CAPand MSDE 
administrative staff, is determining the costs of accountability programs that meet the specifications of 
legislative mandates. 



^ Maryland Hanobook on the AccountabUity Assessment Program, prepared for the Maryland State Department of Education by 
the Center for Educational Research and Evaluation, Research Triangle Institute. (Baltimore: Maryland State department of 
Education. 1974). 
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The Bureau of Educational Research and Field Services (BERFS) at the University of Maryland com- 
pleted this accountability study in conjunction with the MSDE staff. 

The following sections of this monograph present the survey data collected during the exploratory 
study, analyze them, and offer some preliminary conclusions and recommendations for future 
research. The traditional data which are regularly collected are inappropriate for the comprehensive 
analysis required by recent legislation. The survey which was conducted was intended to overcome 
this shortcoming. 

As is often the case with any exploratory study, as many problems as solutions were iaentif led in the 
Maryland project upon which this monograph is based. Both problems and soluiions will be dis- 
cussed in the final section of this report. 



CHAPTER II 
SURVEY INSTRUMENTATION 

One basic objective for the efforts of the Cooperative Accountability Project is to attempt to develop 
quantitative measures which educational decision makers may utilize in determining the most efficient 
accountability allocation in a school budget which necessarily includes many competing activities. 
CAP therefore agreed that the Maryland State Department of Education should attempt to: 

1. Identify and define components of accountability 

2. Specify sources and procedures for obtaining useful cost data 

3. Collect cost information, by sampling, across a broad spectrum of accountability 
activities 

4. Analyze these sample cost data 

5. Recommend procedures for developing and continuing accountability component cost 
programs 

Interview Questionnaire 

An exploratory survey of all the county school systems in the state of Maryland was conducted 
(summer. 1 973) . The questionnai re used in th is survey was developed by professional educators at the 
state and university levels. Questionnaires were sent to each of the 24school systems in the state. Over 
83% of the counties responded to the questionnaire. Each of the 20 school systems which did respond 
had designated an accountability coordinator who was responsible for completing the questionnaire. 
The questionnaire used in the exploratory survey is reprinted in Figure 2.1 through Figure 2.4. 



FIGURE 2.1 



Survey of the Costs of Educational Accountability 
Interview Questionnaire 
PARTI 

SB 166 
28A(a) 

Educational Goal Development and Implementation 

(1) *The State Board of Education and the State Superintendent of Schools shall assist each 
local school board and school system in developing and implementing educational goals and 
objectives in conformity with Statewide educational objectives for subject areas including, 
but not limited to, reading, writing, and mathematics. (3) Each school shall establish as the 
basis of its assessment, project goah and objectives which are in keeping with the goals and 
objectives established by its board of education and the State Board of Education 

Definition: Goal development and implementation are those activities associated with tne establish* 
ment of school board statements of educational emphasis and direction as developed by boards of 
education and school administrators. Such statements result from community, professional, and 
student information sources, and result in statements including both programmatic and priority 
information. An example of source data would be the results of the recent Maryland Goal Validation 
and Needs Assessment Study. 

What is the current level of activities in generating goals statements for your school or 
district? 

Man-days per year Accuracy of estimate percent 

Dollar expenditures Accuracy of estimate percent 

What is the current level of activities in communicating goals statements to staff? (Include 
estimates of both preservice and inservice activities for staff and administrators.) 

Man-days per year Accuracy of estimate percent 

Dollar expenditures Accuracy of estimate percent 

What is the current level of activities in communicating goals statements to the public? 

Man-days per year Accuracy of estimate percent 

Dollar expenditures Accuracy of estimate percent 

What is the current level of activities in preparing reports of goals statements? 

Man-days per year Accuracy of estimate percent 

Dollar expenditures Accuracy of estimate oercent 

'Numerals used in the text of Figures 2.1 through 2.4 refer to specific paragraphs of the Maryland Educational Act 
reproduced in Figure 1.2. 
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FIGURE 2,2 



PART II 

SB 166 

2SA(a) Objective Development and Implementation 

(1) The State Board of Education and the State Superintendent of schools shall assist each 
local school board and school system in developing and implementing educational goals and 
objectives in conformity with statewide educational objectives for subject areas including, but 
not limited to, reading, writing and mathematics, (3) Each school shall establish as the basis of 
its assessment, project goals and objectives which are in keeping with the goals and 
objectives established by its board of education and the State Board of Education. 

Definition: Objective development and implementation are those activities associated with the 
establishment of statements relevant to particular programsorcurricular areas which will facilitate the 
communication between the administration and the classroom. The purpose is to permit the 
evaluation of such programs and curricular attempts. They are seen as the interpretation of 
Educational Goals as they are applied at the classroom level to provide feedbacic and information at 
the student level, Mager (1968) cites three parts of well stated objectives: (1) that the desired outcomes 
be stated in terms of observable behaviors, (2) that the conditions under which the behavior is to be 
displayed be specific, and (3) that the criterion of acceptable performance of the behavior be stated. 

What is the current ^avel of activities in establishing objective development and 

implementation for your school or district? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activities in communicating objectives to staff? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activities in communicating objectives to public? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activities in preparing reports of objectives? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What are the primary areas of concentration for the generating of objectives? Indicate the 
appropriate areas and levels. 

Level 1 23456789 10 11 12 



Area 

Reading 
Writing 
Math 
Other 
(Indicate) 
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FIGURE 2.3 



PART III 

SB 166 

28Afa) Status Survey 

(2) Each School, with the assistance of its local board of education and school system, shall 
survey the current status of student achievement in reading, language and mathematics, and 
other areas in order to assess its needs. (5) Evaluation programs shall concurrently be 
developed to determine if the goals and objectives are being met. (6) Re-evaluation of 
programs, goals and objectives shall be regularly undertpken. 

Definition: Status Survey are those activities associated with the assessment of student performance, 
competancy, and achievement levels. These levels may be established by a variety of instruments; 
attitudinai, interest, aptitude, and achievement based. Examples are follow-up studies, norm 
referenced tests, criterion referenced tests, and assessment exercises. Repeated Status Surveys over 
time provide the feedback loop required by the Accountability Bill to the extent that they are based on 
the established objectives. 

What is the current level of activities in status surveying? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of staff involvement in status surveying? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activities in communicating results of status survey to the 
public? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activity in preparing reports of status surveys? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the primary evaluation tool in your LEA? (i.e.. Norm referenced. Criterion 
referenced, teacher made, Nailonal Assessment). 

Ansvt^r the following questions for this instrument(s). Indicate the appropriate areas and 
levels. 

Level 1 2 3 4 5 6 7 8 9 10 11 12 



Area 

Reading 
Writing 
Math 
Other 
(Indicate) 
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FIGURE 2.4 



PART IV 

SB 166 

28A(a) Program Development 

(4) With the assistance of its local board of education, the State Board of Education, and the 
State Superintendent of Schools, each school shall develop programs for meeting its needs 
on the basis of priorities which it shall set. 

Definition: Program development includes those activities associated with the programmatic inter* 
vention resulting from discrepancies between stated objectives and status survey results. Since 
curriculum development and change is a continuous process, only those activities associated with 
systematic training, observation, and evaluation of such programs should be included. 

What is the current level of activities in program development? 

Man-days per year Accuracy of estimate 



Dollar expenditures Accuracy of estimate % 

What is the current level of staff involvement in program development? (Include estimates 
of both preservice and inservice activities for staff teachers, and school personnel). 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activities in communicating program development to the public? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 

What is the current level of activity in preparing reports of program development? 

Man-days per year Accuracy of estimate % 

Dollar expenditures Accuracy of estimate % 



13 



It can be seen that the respondents were given specific sections of Article 77, Section 28A, of the 
Annotated Code of Maryland (i.e., the Educational Accountability Act) which provided general defini- 
tions of the accountability law. The wording in the law is general in nature and allows the MSDE con- 
siderable discretion as to how its requirements should be implemented. 

Four broad categories of accountability are mentioned in the questionnaire which was desighed to 

elicit from the respondents the current costs of developing, communicating, and reporting the school 
system's: 

1 . Goal statements 

2. Educational objectives 

3. Assessed status of students' performance, competency, and achievement levels 

4. Educational program development 

In addition the accountability coordinators were asked to estimate the accuracy of the figures which 
they reported. 

Survey Materials 

A packet of materials sent to each school system included the questionnaire as well as cover letters 
from the Maryland State Superintendent of Schools.^ No specific information (other than that provided 
in the actual questionnaire) or directions on how to complete the questionnaire were provided to the 
accountability coordinator. Only ex post facto did a MSDE state representative discuss the nature and 
purposes of the survey with each accountability coordinator. 

Observations 

The staffs of the Maryland State Department of Education and the Bureau of Educational Research 
and Field Services made the following observations concerning responses to the survey 
questionnaire. 

1. Some cost items were omitted completely by respondents 

2. Costs for two or more accountability components or sub-components were combined 
by some respondents 

3. Educational cost parameters relating to needs assessment costs, program evaluation, 
and educational support activities were, in many instances, either in the process of 
being compiled or were nonexistent 

In retrospect the former project director should have held a preliminary conference in which all state 
school system accountability coordinators participated. Such a conference should have been used to 
explain the study's intent in detail. Also, the construction of the questionnaire itself could have 
benefited positively from suggestions the local coordinators might have offered. Since the question- 
naire never was pretested, a limited amount of usable information resulted. Incomplete responses and 
total omissions might have been avoided if additional time and effort had been devoted to developing a 
more comprehensive survey instrument. This was the status of the project at the time BERFS was given 
the responsibility for writing a final report. 

The information collected was based on the best estimates of costs by the school systems' account- 
ability coordinators during the 1970-71 year. No attempt is made here to project these components. 
The results presented are analyzed by grouping school systems bytheirenrollmen^size and by group- 
ing counties by measures of their economic position. 



• Letters to the superintendents of schools and to accountability coordinators are found in Appendix A. 
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CHAPTER III 
ANALYSIS OF THE DATA 



General Procedures 

The four accountability components outlined in the Maryland Educational Accountability Act are 
used as the basis for analysis of the exploratory survey data. The components, as noted in Chapter I. 
are (1) educational goal development and implementation; (2) objective development and implemen- 
tatlon;i (3) status surveying of student performance;2 and (4) instructional program development. The 
local educational agencies (LEAs) or s'^hool systems are divided into categories, first, on the basis of 
student enrollment, and secondly, according to the median 1969 family income levels Since it is 
recognized that economies of scale may exist in educational institutions, the differentiating of school 
systems on the basis of student population is a logical choice.a The enrollment intervals selected are 
for student bodies under 10,000; 10,000 to 50,000; and over 50,000. These enrollment Intervals will be 
referred to as small, medium, and large school systems. 

The second arrangement of school systems according to median family income is accomplished 
because of the recognized high degree of collinearity between an area's wealth and Its total educa- 
tional expenditures. Similarly, the expenditures on the identified accountability components also 
should be highly correlated with the area's wealth. Thus the educational expectations that different 
income levels have should be evidenced in the expenditures made by the local school system. 

Finally, it is important to note once again that the data presented in the following tables represent the 
best estimates that school system officials could provide at the time they were queried. Recognition 
also must be given to the inadequacies of the questionnaire itself and to the lack of response consist- 
ency due to insufficient preparation and training of the local accountability coordinators. 

School System Size 

Responses to the survey questionnaire were received from seven Maryland school systems having 
less than 10,000 students; eight in the 10,000 to 50,000 student interval; and five in the over 50,000 
student interval.^ The data obtained for each of these size intervals will be discussed sequentially. 

Small-Sized School Systems 

The average enrollment during the 1970-71 school year in these small school systems was 5,365 
students. Table 3.1 presents the estimated costs which the accountability coordinators reported for 
the goal development and implementation component. 

(It should be noted that the average for Tables 3.1 through 3.9 are computed based upon the systems 
reporting only. When the average shown in Tables 3.1 through 3.9 are reproduced in summary form in 
Table 3.15, the averages are computed lor both reporting and nonreporting school districts.) 



■An eleaboration of the general nature of the goal and objective accountability components is found in Appendix B. 

?A description of the status of surveying accountability component of this report can be found in Appendix C. 

3 It Is generally accepted that an inverse relationshipexists between the per-pupil costs for administration functions and the size 
of the school system, at least until diseconomies set in. Little empirical wortc has been attempted to determine the optimum 
efficient size. (However, the demise of single-teacher schools presents pragmatic evidence that the scale economies do exist. It 
should be noted that the school systems in the state of Maryland coincide with the 23 counties and one city and therefore do not 
represent an attempt by the Maryland State Department of Education to define optimal local educational agencies. Although 
the MSDE refers to these as school systems, hereafter in this monograph the phrase "school district" will be used 
interchangeably with "school system. " 

* The (our county school districts which did not respond fall in the small - and medium-sized categories. These school systems 
and their enrollments are: Caroline (5.346); Garrett (5.707); Wicomico (14,468); and Frederick (20.£?8). 
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TABLE 3.1 



Estimated Goal Development and Implementation Costs 
(School System Enrollment: less than 10.000 students) 



Prepare 
Reports 







Establish 


Communicate 


Communicate 


Of 


Total 


Per- 


School 


1971 


Qoal 


to 


to 


Program 


Dollar 


Pupil 


System 


Enrollment 


Statements 




Public 


Development 


Cost 


Costs 


Kent 


3.926 


$2,400 


$ 2,700 


NR 


NR 


$ 5,100 


$1.30 


Somerset 


4.629 


5,512 


NR 


NR 


NR 


5,512 


1.19 


Queen Anne's 


4,771 


6.500 


1,710 


NR 


$200 


8,410 


1.76 


Talbot 


5.038 


6,000 


700 


NR 


NR 


6,700 


1.33 


Calvert 


6,467 


4,567 


12,000 


$957 


366 


17.890 


2.92 


Dorchester 


6,467 


9,735 


NR 


NR 


NR 


9,735 


1.51 


Worcester 


6.607 


5,730 


NR 


NR 


180 


5,910 


.89 


Average* 


5,365 


$5,778 


$ 4,278 


$957 


$249 


$ 8,465 


$1.56 



NR - not reported 

'Average is of those systems reporting 



The areas wUh small enrollments are agrarian, rural regions, all situated on the Eastern Shore of 
Maryland except Calvert County which Is In southern Maryland. 

It also should be noted that many of the accountability coordinators failed to distinguish between the 
estimated costs for goals and objectives. In such instances the dilemma was resolved by equally dis- 
tributing the costs between the two accountability components. This arbitrary division was Imposed 
on the data received from the Kent school system where the estimated cost of communicating goals 
and objectives to the staff was $5,400 (see Table 3.1 and 3.2). Some of the small LEAs, such as the 
Talbot school system, did attempt to estimate the figures separately. 



TABLE 3.2 

Estimated Objective Development and Implementation Costs 
(School System Enrollment: less than 10,000 students) 



School 
System 


1971 
Enrollment 


Establish 
Objective 
statements 


Communicate 
to 
Staff 


Communicate 
to 
Public 


Prepare 
Reports 
to 

Program 
Development 


Total 
Dollar 
Cost 


Per- 
Pupil 
Costs 


Kent 


3,926 


$2,400 


$2,700 


NR 


NR 


$ 5,100 


$1.30 


Somerset 


4,629 


5.512 


NR 


NR 


NR 


5,512 


1.19 


Queen Anne's 


4,771 


6,500 


1.710 


NR 


$200 


8,410 


1.76 


Talbot 


5.038 


7.600 


7.800 


NR 


NR 


15,600 


3.10 


Calvert 


6,117 


4,567 


12,000 


$957 


366 


17.890 


2.92 


Dorchester 


6,467 


9,735 


NR 


NR 


NR 


9,735 


1.51 


Worcester 


6,607 


5,730 


NR 


NR 


180 


5,910 


.89 


Average* 


5,365 


$6,035 


$6,053 


$957 


$249 


$ 9.737 


$1.81 



NR - not reported 

'Average is of those systems reporting 
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The per-pupil expenditures presented in the tables must be interpreted carefully, and inferences 
based on the individual component values are suspect. 

For the small LEAs, the average estimated per-pupil expenditures in the goals and objectives cate- 
gories are $1 .58 and $1 .81 , respectively. Naturally it should be realized that the costs of these compo- 
nents are more difficult to measure than is the status surveying component. The latter component can 
be tied directly to purchasing of test materials, along with administering the tests and grading them. 

Table 3.3 shows the projected estimates for the status survey component that three small LEAs sub- 
mitted in response to the survey questionnaire. 

TABLE 3.3 

Projected Status Surveying Costs 
(School System Enrollment: less than 10,000 students) 



1972-73 status Survey: 

Prepare 
Reports 



School 
System 


1971 
Enrollment 


Establish 
Status 
Surveying 


Communicate 
to 
Staff 


Communicate 
to 
"ubiic 


of 

Program 
Development 


Total 
Cost 


Per-Pupil 
Cost 


Taltwt 


5.038 


$11,750 


$3,225 


$7,250 


$ 350 


$22,575 


$4.48 


Calvert 


6.117 


NP 


9.750 


NR 


1,740 


11.490 


1.88 


Worcester 


6.607 


9,540 


9,540 


NR 


NR 


19,080 


2.89 


Average* 


5,921 


$10,645 


$7,505 


$7,250 


$1,045 


$17,715 


$2.99 



NR - not reported 

'Average is of those systems reporting 



In comparison to the figures already presented, it can be seen that the estimated costs reported for 
the goal and objective development and implementation components are much lower than for the 
more tangible status surveying element. Since many more judgmental decisions must be made in 
determining the time and effort expended on developing goals and objectives, this discrepancy is not 
too surprising. It does indicate, however, that substantial preparation should be required prior to 
administering this type of questionnaire so that more uniformity and completeness in reporting may be 
obtained. 

Medium-Sized School Systems 

The medium-sized school systems in the exploratory survey also are located in predominantly rural 
areas of the state of Maryland. Two of these areas are urban tier counties adjacent to the Baltimore and 
Washington Standard Metropolitan Statistical Areas (SMSA); consequently, they are experiencing 
extremely rapid rates of population growth. These tv.o counties are Howard and Harford.s The 
school systems in the medium-sized category appear better able to estimate the costs of the various 
components of goal development and Implementation, at least as judged by the Increased consist- 
ency in responses when viewed against responses from small-sized systems. 

Table 3.4 shows that the average estimated cost of the goal development and implementation com- 
ponent for medium-sized school systems in $1.66 per pupil. 



The cost I nformation supplied for Howard County may be particularly dated today since the data reported covers a period ori or 
to the establishment of the "new city" of Columbia as a viable entity. Therefore it would be expected that these cost estimates 
have changed substantially since the survey was administered. A new effort should be launched to get at the component costs 
with more systematic preparations and controlled circumstances. 
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TABLE 3.4 



Estimated Goal Development and Implementation Costs 
(School System Enrollment: between 10.000 & 50.000 students) 



Prepare 
Reports 
of 







Establish 


Communicate 


Communicate 


of 




Par 


School 


1971 


Goal 


to 


to 


Program 


Dollar 


r- jpii 


System 


Enrollment 


Statements 


Staff 


Public 


Development 


Cost 


Costs 


St. Mary's 


11.856 


$10,000 


$ 80 


$ 80 


$ 360 


$10,520 


$ .89 


Cecil 


12.378 


17.770 


6.975 


600 


270 


25.615 


2.07 


Charles 


14.437 


10.000 


3.250 


150 


13.000 


26.400 


1.83 


Carroll 


17.213 


9.000 


7.200 


3.000 


3.000 


22.200 


1.29 


Allegany 


17.589 


3.000 


12.960 


6.000 


1.350 


23.310 


1.33 


Howard 


19.049 


6.200 


9.600 


960 


1.500 


18.260 


.96 


Washington 


24.053 


12.870 


5.000 


34.900 


6.000 


58.770 


2.44 


Harford 


31.620 


48.000 


NR 


NR 


13.335 


61.335 


1.94 


Average* 


18.524 


$14,605 


$ 6.438 


$ 6.527 


$ 4.852 


$30,801 


$1.66 



NR - not reported 

'Average is of those systerr.a reporting 

The range and variance of the estiinates is reduced vis a vis the first category The average per-pupil 
expenditure is quite similar to that of the small-sized systems. 

With respect to the estimated costs of objective development and implementation, however, the 
variance for medium-sized LEAs is greater than for small LEAs (see Table 3.5). 

TABLE 3.5 

Estimated Objective Development and Implementation Costs 
(School System Enrollment: between 10.000 & 50.000 students) 



Schoot 
System 


1971 
Enrollment 


Establish 
Objective 
Statements 


Communicate 
to 
Staff 


Communicate 
to 
Public 


Prepare 
Reports 
to 

Program 
Development 


Total 
Dollar 
Cost 


Per- 
Pupil 
Custd 


St. Mary's 


11.856 


$ 9.000 


NR 


NR 


$6,900 


$15,900 


$1.34 


Cecil 


12.378 


1.770 


$ 6.975 


$ 600 


270 


9.615 


.78 


Charles 


14.437 


65.000 


3.750 


3.750 


1.500 


74.000 


5.13 


Carroll 


17.213 


8.000 


18.000 


1.200 


1.200 


28.400 


1.65 


Allegany 


17.589 


3.000 


12.960 


6.000 


1.350 


23.310 


1.33 


Howard 


19.049 


4.660 


17.400 


50 


SO 


22.180 


1.16 


Washington 


24.053 


15.732 


5.525 


3.250 


6.825 


31.332 


1.30 


Harford 


31.620 


57.550 


15.000 


NR 


NR 


72.550 


2.29 


Average* 


18.524 


$20,592 


$11,373 


$2,475 


$2,585 


$34,661 


$1.87 



NR - not reported 

'Average is of those systems reporting 
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Two possible explanations for this occurance are: (1 ) some of the estimates are questionable, or (2) 
the distinction between goals and objectives was not consistently interpreted by the accountability 
coordinators. In the latter case it is a matter of proper p'^eparation of the questionnaire and the 
respondents. In the data obtained the estimated per-pupil expenditures for objective development in 
the Charles Ccunty school system seems to be high, if the other area estimates are to be believed. 

The projected costs for status surveying also show a high degree of variability for both small- and 
medium.-sized school systems, as can be seen in Table 3.6.^ This variability may be attributed to the 
absence of a statewide status surveying program during the survey period (see Appendix C for a 
discussion of the various testing procedires utilized within Maryland at the time of the survey). 
Hopefully, once a standardized statewide system of status surveying is implemented, the reliability of 
the cost data will improve. 

TABLE 3.6 

Projected Status Surveying Costs 
(School System Enrollment: between 10.000 & 50^000 students) 



Project Costs: 1972-73 Status Survey: 

Prepare 
Reports 







Establish 


Communicate 


Communicate 


of 






School 


1971 


Status 


to 


to 


Program 


Total 


Per-Pupil 


System 


Enrollment 


Surveying 


Staff 


Public 


Development 


Cost 


Cost 


St. Mary's 


11.856 


$27,000 


$ 6,300 


NR 


NR 


$33,300 


$2.81 


Charles 


14.437 


52,000 


NR 


NR 


NR 


52.000 


3.60 


Carroll 


17.213 


48.600 


48.600 


NR 


NR 


97.200 


5.65 


Washington 


24.053 


9.625 


1.105 


$300 


$2,340 


13,370 


.56 


Harford 


31.620 


15.000 


17.500 


NR 


500 


33,000 


1.04 


Average* 


19,836 


$30,445 


$18,376 


$300 


$1,420 


$45,774 


$2.31 



NR - not reported 

'Average is of those systems reponng 



Large-Sized School Systems 

The school systems included in this category serve densely populated, urban and central city areas. 
The estimated per-pupil development costs in the large-sized school systems are significantly lower 
than for the two smaller categories. Table 3.7 shows that the average estimated per-pupil costs in the 
large-sized school systems are $ .40. 

The variance in these per-pupil cost estimates is unacceptably large. The nature of the various 
school systems tends to influence the per-pupil expenditures for each of the accountability compo- 
nents. Baltimore City can be characterized by urban poverty and reflects the general, national decline 
of central cities; it also spends the least per pupil for goal development, whereas Montgomery County, 
which is predominantly upper middle class in nature, spends the most on goal development both in 
absolute and relative terms. The estimated cost of objective development in Table 3.8 shows less 
variability than for goal development. 



' With so much cost variability in the data, both within and between the different size school categories, the need for a more 
uniform method by which accountability costs can be determined by SEAs and LEAs is reinforced. Such a study is far beyond 
the scope of this effort, but nevertheless should be pursued. 
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TABLE 3.7 

Estimated Qoal Development and Implementation Costs 
(School System Enrollment: over 50,000 students) 



School 
System 


1971 
Enrollment 


Establish 

Goal 
Statements 


Communicate 
to 

Staff 


Communicate 
to 
Public 


Prepare 
nopuiio 
to 

Program 
Development 


Total 
Dollar 
Cost 


P»r- 

Pupil 
Costs 


Anne Arundel 


75,452 


$ 2,000 


$ 300 


$1,000 


$43,695 


$4b,995 


$.62 


Montgomery 


126,679 


57,000 


NR 


NR 


50,000 


107,000 


.84 


Baltimore 


134,136 


34,000 


1.0U0 


NR 


1,035 


36,035 


.27 


Prince George's 


162,850 


70,000 


2,900 


1,500 


2,000 


76,400 


.47 


Baltimore City 


190,735 


5,900 


2,640 


1,820 


NR 


10,360 


.05 


Average* 


137,970 


$33,780 


$1,710 


$1,440 


$24,163 


$ 55,358 


$.40 



NR - not reported 

'Average is of those systems reporting 



TABLE 3.8 

Estimated Objective Development and Implementation Costs 
(School System Enrollment: over 50,000 students) 



School 
System 


1971 
Enrollment 


Establish 
Objective 
Statements 


Communicate 
to 
Staff 


Communicate 
to 
Public 


Prepare 
Reports 
to 

Rrogram 
Development 


Total 
Dollar 
Costs 


Per- 
Pupil 
Costs 


Anne Arundel 


75,452 


$ 74,916 


$ 74,916 


$ 2,000 


$35,000 


$186,832 


$2.48 


Montgomery 


126,679 


15,000 


183,000 


NR 


NH 


198.000 


1.56 


Baltimore 


134,136 


96,250 


96,250 


NR 


3,000 


195,500 


1.46 


Piince George's 


162,850 


11,600 


15,562 


15,562 


NR 


42,724 


.26 


Baltimore City 


190,735 


117,180 


117,180 


NR 


NR 


234,360 


1.23 


Average* 


137.970 


$ 62,989 


$ 97,382 


$ 8.781 


$19,000 


$171,483 


$1.24 



NR - not reported 

'Average is of those reporting 



Only the figures for Prince Georges County seem un representatively low. The need and natural 
inclination for school systems to concentrate attention on short-range aims seems to be evidenced 
here. The daily needs of school systems are more closely tied to the category of objective develop- 
ment and implementation than to goal development and implementation. 

Little can be said concerning the data presented in Table 3.9 which gives the projected cost of status 
surveying in large school systems. 
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TABLE 3.9 



Estimated Cost for Status Surveying 
(School System Enrollment: over 50.000 students) 



Project Costs: 1 972-73 Status Survey: 

Prepare 



School 
System 


1971 
Enrollment 


Establish 
Status 
Surveying 


Communicate 
to 

Staff 


Communicate 
to 
Public 


Reports 
of 

Program 
Development 


Total 
Cost 


Per-Pupll 
Cost 


Anne Arundel 


75.452 


$32,000 


$47,500 


$1,400 


NR 


$80,900 


$1.07 


Baltimore 


134.136 


53.000 


25.000 


1.200 


$1,100 


80.300 


.60 


Prince George's 


162.850 


60.000 


10,000 


100 


500 


70.600 


.43 


Average* 


124.146 


$48,333 


$27,500 


$ 900 


$ 800 


$77,267 


$ .62 



NR • not reported 

'Average Is of those systems reporting 



The differing testing procedures formerly utilized in each system, as well as the shift by the MSDE to 
a statewide assessment program using the Iowa Test of Basic Skills (ITBS) and the Cognitive Test of 
Abilities (CAT), suggest some possible explanation as to the failure of all large school systems to 
respond to the question. 

Income Levels 

Since the data to be discussed here has been previously presented and Is merely reorganized, it will 
be given in a single table. Table 3.10 ranks the counties in the state of Maryland according to their 
median income levels. The three median income levels during 1969 into which the counties are organ- 
ized are: (1) over $10,000; (2) between $8,000 and $10,000; and (3) under $8,000. 

As was discussed previously there is a high correlation between median family i ncome and total per- 
pupil expenditure, i.e., a strongly positive relationship exists between these variables. A similar 
relationship would be expected for the various components of accountability, but the data obtained in 
the survey do not confirm this hypothesis. An alternative possibility is that, since the larger school 
systems are able to draw upon more system resources than the smaller systems, they may expend less 
per pupil for accountability functions. For the smaller systems and generally less affluent areas, to 
institute new procedures may require the addition of staff personnel, whereas the larger systems have 
a broader base of personnel from which to draw. The final section of this chapter suggests a possible 
explanation fur these discrepancies. 

Program Development Funding 

The three sources of primary and secondary school financing are local, state, and federal funds. 
These sources form the basis for the last accountability component identified as program develop- 
ment. In the state of Maryland local sourcesof revenue provided 58.4% of the school budget. Similarly, 
state and federal funding provided 32.9% and 8.7%, respectively. Table 3.1 1 illustrates, by county, the 
contributions of each of the government sectors to current public school expenses. The federal contri- 
bution generally is under 15% of current expenses except in areas such as St. Mary's County which 
relies on 'Impacted area aid*' because of the location of a large transient military population in that 
county. 
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TABLE 3.10 
Estimated Per-Pupil Accountability Costs 



1 

IncomeCategory 


r i 

Median 


■ 




Estimated Per-Pupil Accountability Co.sts 
















Family 








Total 


Total 




Income 


School 








Component 


Per-Pupil 




1969 


Enrollment 


Goals 


Objectives 


Status 


EstimalBS 


Expenditures 


High Income 
















(over SI 0,000) 
















Montgomery 


$16,706 


126.C79 


$ .84 


1.56 


N R 


$2.40 


$1,121 


Howard 


13.461 


19.049 


.96 


1.16 


N R 


9 19 


643 


Prince George's 


12.445 


162,850 


.47 


.26 


.43 


1 lA 


913 


Baltimore 


12.072 


134.136 


.27 


1.46 


.60 


9 


909 


Anne Arundel 


1 1 .474 


75.452 


.62 


2.48 


1.07 


d 17 


774 


Harford 


10.750 


31,620 


1.94 


2.29 


1.04 


97 


750 


Charles 


10.367 


14.437 


1.83 


CIO 


Q fin 


in CbA 


743 


Carroll 


10.180 


17.213 


1.29 


1.65 


5.65 


8.59 


697 


Middle Income 
















($8,000-$ 10.000) 
















Frederick 


9,547 


20,928 


N R 


N R 


N R 


M R 


797 


Cecil 


9,004 


12.378 


2.07 


.78 


N R 


9 


700 


Baltimore City 


6,814 


190.735 


.05 


1.23 


N R 


1 9A 


646 


Wicomico 


8.781 


14.466 


N R 


NR 


NR 


N R 
1^ n 


674 


Washmgton 


6.776 


24,053 


2.44 


1.30 






806 


Calvert 


6.739 


6,117 


2.92 


2.92 


1.88 


7.72 


741 


St. Mary's 


8.266 


11.856 


.89 


1.34 


2.81 


5.04 


716 


Queen Anne's 


8.209 


4.771 


1.76 


1.76 


NR 


3.52 


714 


Talt)ot 


8.059 


5,038 


1.33 


3.10 


4.46 


8.91 


817 


Allegany 


8,031 


17.589 


1.33 


1.33 


NR 


2.66 


754 


Low Income 
















(under $8,000) 
















Dorchester 


7,701 


6.467 


1.51 


1.51 


NR 


3.02 


764 


Kent 


7,624 


3,926 


1.30 


1.30 


NR 


2.60 


810 


Caroline 


7.420 


5.346 


NR 


NR 


NR 


N R 


700 


Worces>er 


7,386 


6,607 


.89 


.89 


2.89 


4.67 


718 


Garrett 


6.023 


5,707 


NR 


NR 


NR 


NR 


668 


Somerset 


5,878 


4,629 


1.19 


1.19 


NR 


2.38 


645 



U S. Bureau of the Census, 1972, 7972 County-City Data Book, U.S. Oep&rtment of Commerce (Washington. O.C.: U.S. 
Government Printing Office, 1973), Table 2 - Counties, p. 225, Item 58. 



Maryland State Department of Education. Facf5 About Maryland Public Education 1971-72, A Statistical Handbook (Baltimore: 
Maryland State Department of Education, 1973), pp. 16-17. 

NR - Not reported 



Small-Sized School Systems 

Table 3.12 presents the estimated funding sources for the small school systems. It is evident that the 
federal government sponsors most of the small-sized school systems in terms of program develop- 
ment. This is in direct contrast to the total funding pattern. This federal funding may be viewed as 
manna by the LEA authorities, and therefore they may be willing to utilize it for fewer programs which 
provide less immediate and tangible results. 
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TABLE 3.11 



Cost Per Pupil B«fQfH|iiH|: 
Currenf ExpMim:* 
M«ylaiHt PubSe SehooKi: 1970-71* 



UoaiUnlt 



ItiMMiitt^Piimf* 




'EMcludea transportMiOft but fnoHtdBa SM0 Share of Teaehon' Ratiromant atu/ SoiM Saeurtty. 

•Maryland State 0«p«rtment of Education. Facft About MatylaM Publfc education im-7i. A ^Mtatktaf Mantfbook. 
(Baltimore: Maryland State Oepertment of Education. 1973). pp. I6.i7. 



Medium-Sized School Systems 

As the size of the school system increases to over 10,000 students, local support for program 
development also appears to increase. Table 3. 13 shows that, proportionately, the local funding con- 
tribution increases relative to the federal funding, although in absolute terms, this increase does not 
appear to be a significant one. It is notable that the average federal per-pupil contribution declined 
from $44.88 for the under-10,000 student systems to $18.72 for those systems with 10.000 to 50,000 
students. 
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TABLE 3.12 



Federal, State, and l -cal Program Expenditures Per Pupil 
(School System Enrollmant: less than 10,000) 







Per-Pupil Costs 








Percent of Funding 




School 








Total 








System 


Federal 


State 


Local 


Funds 


Federal 


State 


Local 


Kent 


$30.06 


0 


$5.43 


$35.49 


84.7 


0 


15.3 


Somerset 


59.41 


0 


3.73 


63.14 


94.1 


0 


5.9 


Queen Anne's 


33.12 


0 


5.87 


36.99 


84.9 


0 


15.1 


Talbot 


32.16 


0 


0 


32.16 


100.0 


0 


0 


Caivsrv 


64.57 


$3.11 


6.54 


74.22 


87.0 


4.2 


8.8 


Dorchester 


46.39 


0 


1.62 


48.01 


96.6 


0 


3.4 


Worchester 


48.43 


7.67 


1.55 


57.55 


84.2 


13.1 


2.7 


Average 


$44.68 


$1.53 


$3.53 


$49.94 


89.8 


J.I 


7.1 



TABLE 3.13 



Federal. State, and Local Program Expenditures Per Pupil 
(School System Enrollment: between 10.(XX) and 50.000) 



Per-Pupil Costs 



Percent of Funding 



School 
System 



Federal 



State 



Local 



Total 
Funds 



Federal 



State 



Local 



St. Mary's 


$25.30 


0 


$ 2.97 


$28.27 


89.5 


0 


10.5 


Cecil 


18.66 


0 


-0 


18.66 


100.0 


0 


0 


Charles 


26.04 


0 


.64 


26.68 


97.6 


0 


2.4 


Carroll 


11.85 


0 


11.62 


23.47 


50.5 


0 


49.5 


Allegany 


29.97 


0 


10.00 


39.97 


75.0 


0 


;!S.O 


Howard 


9.19 


0 


3.94 


13.13 


70.0 


0 


30.0 


Washington 


17.67 


0 


1.03 


18.70 


94.5 


0 


5.5 


Harford 


11.07 


0 


2.09 


13.16 


84.1 


0 


15.9 


Average 


$18.72 


0 


$ 4.04 


$22.76 


82.3 


0 


17.7 



Large-Sized School Systems 

The federal per-pupil expenditures appear to continue to decline as the system sizeincreases ^o over 
50,000 Students. The single exception is Baltimore City which exhibits a dramatic jump to $56.78 per 
pupil, as indicated in Table 3.14. This surprising change may be attributed to the fact that Baltimore 
City is a SMSA central city into which largeamounts of federal funding have been poured in an attempt 
to reverse the continuing decline of core cities. It also appears that the areas receiving the largest pro- 
portions of federal funding are those which have been experiencing substantial out-migration over the 
period of the last two decades, i.e., rural America and the urban core cities. Since both areas are less 
able to finance any type of public expenditures through local sources, it is only reasonable that trans- 
fers of wealth should be attempted by the federal government. From the data obtained in this survey it 
is not possible, however, to make a definite judgment on the subject. 



ERLC 
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TABLE 3.14 
Federal. State, and Local Program Expenditures Per Pupil 
(School System Enrollment: over 50,000) 



Per-Pupil Costs 



School 

System Federal State Local 



Anne Arundel $10.47 0 $5.19 

Montgomery 4.97 0 .63 

Baltinfiore 8.35 0 .60 

Prince George's 7.37 0 0- 

Baltinfiore City 56.76 0 1.31 

Average $17.19 0 $1.55 



Percent of Funding 



Total 

hunds Federal State Local 



$15.66 66.9 0 33.1 

5.60 88.8 0 11.2 

6.95 91.4 0 6.6 

7.37 100.0 0 0 

58.09 97.7 0 2.3 

$18.74 91.7 0 8.3 



Summary of Findings 

From the data obtained in the Maryland accountability survey, few substantive conclusions can be 
drawn. General conclusions and recommendations related to the total study are presented In Chapter 
IV. However, Table 3.15 does present a concise review of the average estimates obtained. The average 
data indicate, that, if any scale economies do exist, they occur in school systems with a student enroll- 
ment exceeding 50,000. The cost estimates for small- and medium-sized school systems appearquite 
similar. 

An overview of the most salient findings may be obtained by examining the goal and objective cost 
components. Here it is seen that the small- and medium-sized school systems incur higher per-pupll 
costs than do the large-sized systems. In the status surveying component the inverse relationship 
between per-pupil expenditures and system size is apparent. The funding sources for goal and objec- 
tives programdevelopmentalsoexhibitasimilarrelationshipalthough, in both instances, the medium- 
sized districts-^^whilepracticallyequivalenttosmalldistrictexpenditures— were slightly higher intheir 
per-pupil costs. 

Thus it appears that the fixed costs involved in all of these four components are high, and therefore 
the larger school systems are better able to absorb them by distributing them across the larger student 
population. However, any generalization about these particular survey data should be left to another 
time when more complete educational components cost data have been collected. The basic con- 
clusion reached in this survey is that smaller school systems will require additional financial aid and 
technical assistance in establishing a comprehensive accountability program. This is something legis- 
lators and lawmakers should keep in mind when instituting accountability requirements since the 
small school systems generally are the least affluent and therefore are least able to finance the 
program costs internally. 
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TABLE 3.15 
Summary of Cost Estimates 



LEA Size 
Category 


Mean 

Enrollment 

1 


:- = L_:_= 

Mean Cost Levels 


Establish 
Statements 


Communicate 
to Staff 


Communicate 
to Public 


Prepare 
Reports 


Total 


Mean Per- 
Pupil Cost 


Goal Developmer 

and Implernenta- 

tion 

Small 

Medium 

Large 


It 

5.365 
18,524 
137,970 


$5,778 
14,605 
33,780 


$2,444 

5;633 
1,368 


$ 137 
5.711 
864 


$ 107 
4 852 
19,346 


$ 8.466 
30.801 
55,358 


$1 58 
1.66 
.40 


Objective Develo 
ment and Imple- 
mentation 

Small 

Medium 

Large 


J- 

5,365 
18,524 
137,970 


6,035 
20,592 
62,989 


3.459 
9,951 
97,382 


137 
1.856 
3.512 


107 
2,262 
7.600 


9,738 
34,661 
171,483 


1.82 
1.87 
1.24 


Status Surveying 

Small 

Medium 

Large 


5.921 
19.836 
124,146 


7.097 
30,445 
48,333 


7.505 
14.701 
27.500 


2.417 
60 
900 


697 
568 
533 


17.716 
45.774 
72.266 


2.99 
2.31 
.62 



Sourcesof Funding Mean Funding by Source (Per Pupil) Percent of Funds 



Program Expendi-| 
tures i 
* 


Federal 

' 


State 




Local 


Total 


Federal 


1 

State 


Local 


Small 




$44.86 


$1.53 


$3.53 


$49.94 


89.8 


3.1 


7.1 


Medium 




18.72 


0 


4.04 


2'2.76 


82.3 


0 


17.7 


Large 




17.19 


0 


1.55 


18.74 


91 7 


0 


8.3 
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CHAPTER IV 
CONCLUSIONS AND RECOMMENDATIONS 

Exploratory Study Conclusions 

As in any exploratory study such as this one. the questions raised by the project tend to exceed in 
number those answered. Also, the tendency for preliminary analyses to provide obvious and self- 
evident conclusions has been confirmed. However, substantial insight has been provided by the 
research, particularly into some of the pragmatic problems inherent in attempting to quantify 
previously unmeasured phenomena. The need to specify and define more completely the program 
components which are to be measured is inescapable. Failure to do so leads to inconsistent responses. 
In addition, the sample units selected are not homogeneous. For both of these reasons, the data 
obtained are not really comparable among school systems. The Maryland Accountability Act makes a 
preliminary attempt to define overall goals in broad program areas. However, the defined areas of 
concern (goal, objective, status surveying, and program development) are vague and need to be made 
more explicit and concrete. Also, the sampling procedure of selecting a local accountability 
coordinator inevitably leads to biased responses. Such bias is not concious in nature and must be 
eliminated whenever possible. In addition, when special interest groupsare involved and thequestions 
asked of them are vague, the results obtained necessarily will be questionable and inconsistent. Such 
problems can be remedied only by defining more carefully the accountability components, 
redesigning the sampling procedures, and utilizing a systems analysis approach in fitture research of 
this nature. 

Long-Term Goals 

The desiretoapplysystems analysis techniques toevaluating publiceducational institutions cannot 
be realized immediately; the changes required to implement an Educational Components Cost of 
Accountability Program (ECCAP) are both philosophical and pragmatic. Therefore, such changes 
require a gestation period in order to assure the proper nurturing and development of the concepts. 
Otherwise, the attempts will be abortive and of little use to SEA-LEA educational systems. 

Defining Accountability Components 

All accountability components must oe defined in specific and concrete terms. This entails 
specifying programs and defining their C'«»sired objectives. The life-cycle costing of these programs 
involves assigning dollar values to each of the developmental stages through which any program 
progresses from establishment to implemention to evaluation. The purpose of an educational 
components cost of accountability program is to do'velop a consistent procedure against which alter- 
natives can be evaluated. 

An example of how the accountability process might be envisioned could be evaluating the creation 
Ota new curriculum such as one to improve the reading abilities of primary school children. The overall 
goal in this instance would be to increase the literacy of the school children. 

(Goals such as this one are determined through the work and cooperation of many groups in 
society.^ Societal goals are broad in nature and, therefore, a statement of goals frequently does not 
specify how the desired ends are to be achieved. Thus goals may be merely a statement of the desired 
consequences.) 

While the overall goal in our cited example is increased literacy of primary school children, the 
definition of more specific objectives is required. These objectives are used to evaluate the success in 
achieving the specified ends. The resposibility for specifying objectives rests primarily on the 
shoulders of professional educators. One specific objective in the case of increasing literacy might be 
determining a minimum desired improvement in the number of words read per minute at some pre- 



' Here society is used in its general sense to include parents, professional educators, legislative and governmental bodies. 
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determined level of comprehension Given a set of quite specific objectives— such as the one just 
suggested— a program then may be developed and implemented to achieve the specified objectives. 
Finally, thesuccessof the endeavor should be evaluated, probably through theuseof somestanaard- 
ized testing or criterion-referenced testing program. This might entail purchasing standardized 
testing materials (e.g., Iowa Test of Basic Skills or Cognitive Abilities Test) on a statewide basis, or the 
development, construction, and validation of appropriate criterion-referenced materials. 

One aspect of accountability seeks to assign a consistent measure— the dollar— to the cost of 
implementing any given program. Obviously the costs associated with each phase of the program 
must be estimated. The intent here is not to determine the efficiency of the program, perse, but rather 
its efficacy in terms of alternatives which may be available for achieving the desired objective(s). In 
fact, the efficient operation of a program is a distinctly different question. In order to compare alter- 
natives it is necessary to calculate the costs of each entire prograin from its inception through its 
development, implementation, and evaluation. 

Thus the costs of determining societal goals, specifying actual objectives, developing particular 
programs, and evaluating results all must be ii icluded in the accountability calculation. In dealing with 
a manufacturing process, such procedures are much more concrete, and the measures more readily 
available. In education it is recognized that goals and objectives are much more amorphous. And yet 
educational goals can be specified, and every attempt must be made to do so. 

Determining Component Costs 

In order to achieve accountability it is requisite for the educational evaluator to understand his 
present position. This requires a comprehensive study to define currently existing educational 
programs and to determine the costs associated with each one. Such an analysis requires the selection 
of the appropriate units to be analyzed. The sample groups used in the study reported in this 
monograph are not homogeneous in any respect, except that each observation represents a single 
school system. The diversity among the systems is quite complex and vast. It must be recognized that 
school systems themselves are not homogeneous and that comparisons among school systems will 
not yield much insight into the alternative means of achieving quite diverse goals. 

Any accountability surveying, therefore, must be stratified according to inherent similarities of 
individual schools or classrooms. Sample data should be collected among the school systems by 
grade, department-content area, and school type. The actual sampling should be accomplished in the 
classroom, by an outside observer, with the cooperation of the teacher, department chairpersons, and 
principal. Problems of such a study are apparent. The individual teacher may view the surveyor not as 
an Impartial observer but as a personal evaluator. Teachers' organizations also may view such a survey 
as an attempt to impose new rules and controls on teachers. It is mandatory that an observer be a dis- 
interested party whose findings will be analyzed only in aggregate terms. In addition it is the respon- 
sibility of the school system to assure all parties that the survey results will not be used to reward or 
punish individual teachers or schools. Only by gaining the cooperation and active assistance of the 
local educators and their representative organizations can any usable system of accountability be 
introduced. 

Once this cooperation has been obtained some of the variables which are relevant in assuring the 
comparability of data are grade level, student achievement, department-content, socioeconomic 
setting, teacher salaries, education and experience level of staff, and school type. It also is imperative 
that obsen/ers be well and consistently trained so that measurement errors can be reduced to a 
minimum. A representative sample might involve five percent of the schools or approximately 65 
public schools in the state of Maryland, on all grade levels. Obviously such an analysis is an under- 
taking of large magnitude. In the interim it is necessary to extend the preliminary work begun by this 
exploratory project which was a step in the right direction, albeit a small one. 

Short-Term Objectives 

Future analyses should build upon this exploratory study with the recognition that developing a 
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usable educational components cost of accountability system will require much additional work. With 
this in mind the following steps must be considered: 

1. Review existing accountability laws 

2. Determine the goals of a particular educational system 

3. Specify objectives and develop appropriate programs 

4. Specify t^e status survey requirements of student performance 

5. Estimate the costs of the various components 

The first three steps must be accomplished by the state education agency in concert with its local 
education agencies. Assistance may be given for determining the costs associated with the goals, 
objectives, and program development. A handbook should be developed to help school systems 
implement educational components cost of accountability programs. Efforts in this direction already 
are underway in the Maryland State Department of Education. MSDE checklists provide a framework 
which other SEAS and LEAs may use in their own endeavors to devise educational components cost of 
accountability programs within their own states. 

RAcommended Checklltts for ECCAP Activitiea 

After completing this Maryland exploratory study of an Educational Components Cost of Account- 
ability Program, a series of checklistss was constructed to provide guidelines for SEA and LEA 
officials. Three checklists specify the planning, implementation, and evaluation activities required for 
an ECCAP. Hopefully, these checklists will serve as a framework for future cost-pricing studies. 

Checklist 1 ii'ustratas the planning tasks that SEA-LEA personnel should consider in the develop- 
ment of an Educational Components Cost of Accountability Program. In general it specifies those 
planning tasks needed to answer the questions related to how decision makers should design an 
ECCAP. The major tasks include: (1) gaining background knowledgeof accountability in the state; (2) 
cost-pricing program objectives and outcomes; and (3) utilizing a systematic approach to the ECCAP 
problems. 

Checklist 2 provides a general framework for the implementation task involved in an Educational 
Components Cost* of Accountability Program. It highlights both organizational and operational 
considerations that should be addressed when determining what activities are to be pursued to initiate 
maintain, and conclude an ECCAP. 

Checklist 3 for ECCAP evaluation activities consists of two sections. On the left-hand portion of the 
checklist is a delineation of planning and implementation tasks already cited in Checklists #1 and #2. 
On the right-hand portion of the Checklist is a set of evaluation models which could be used in the 
evaluative aspect of the Educational Components Cost of Accountability Program. The idea behind 
this approach is for SEA decision makers to delineate as many evaluation models as necessary and 
adapt or combine components of these models which would meet the evaluative needs of the ECCAP 
in a given state. Having such models to choose from places one in the inevitable position of being 
eclectic (i.e.. choosing those areas applicable to the accountability costs from already-established 
evaluation models to best meet the needs of the situation.) The main objective is to take the most 
rational and logical method to systematically evaluate the ECCAP. 

This third Checklist can be utilized by the SEAs and LEAs in applying one of the existing models to 
evaluating their educational systems. In addition it presents a concise, uniform framework with which 
to categorize any new evaluation model which may be developed. The Checklist also may serve to 
facilitate the development of new evaluation models by providing the model builder some of the 
important elements which must be considered in developing an accountability model. 

Recommendations 

It is recommended that the next necessary step in developing an operational Educational 

'ChecKlists (or ECCAP activities are found in Appendix 0. 
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Components Cost of Accountability Program is the preparation of a handbook based on the check- 
lists presented or upon some similar guidelines. Such a handbook would be intended to be used by the 
SEAs and LEAs to assist them in tho planning, designing, implementing, evaluating, and costing of a 
comprehensive accountability program. The handbook itself would review appropriate systems 
analysis techniques and apply them to educational components costofaccountabilityforeducational 
institutions. 

The exploratory survey conducted as the basis for this nnonograph may be used in the development 
of a handbook. Problems encountered with respect to the creation of appropriate survey instruments 
must be considered and corrected. The categorization and classification of the surveyed units must be 
made a function of the goals, objectives, and programs as they are defined by the SEAs and LEAs 
rather than merely using school systems as the minimunn-sized sample unit. 

This exploratory study has not provided a definitive statem'^nt with regard to the costs of public 
educational accountability. Rather, the study was conceived and undertaken in an attempt to establish 
a solid foundation of costs associated with the implementation of accountability systems. The 
problems encountered in this study should serve to strengthen future projects which will be better 
able to avoid similar pitfalls. 

The recommended follow-up activities of the project are ambitious and will require much additional 
work, both on the theoretical and applied levels. Since accountability is such a relatively new concept 
with respect to public school systems, the need for additional work was anticipated. Eventual benefits 
should, however, fully justify the developmental efforts and costs which will be incurred. 
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APPENDIX A 



LETTERS OF INTRODUCTION TO THE 
MARYLAND STATE DEPARTMENT ACCOUNTABILITY COMPONENT COST STUDY 



To the Superintendent of Schools: 

The attached letter and interview guide are being 
sent to the Accountability Coordinator for your school 
system. Dr. Griffith will be arranging an interview 
with this individual In the near future. 

Thank you for your continuing cooperation. 



^AMCS A aCNSCNOAuriM 




Maryland State Dbparthent op Education 



PC. Box 8717 

PiviiNDiHiF International AiivfoiVT 



Baltimore Mar land 21240 



May 21, 1973 



Sincerely yours, 




JAMBS A. SENSENBAUGH 
State Superintendent of Schools 



JAS:M:dw 



Attachments 



ERIC 




Maryland State Department or Education 



P O Box B 71 I 



Fricndship International Airport 



Baltimore. Maryland 21740 



May 21, 1973 



To the Accountability Coordinator: 

Under the auspices of the Cooperative Interstate Project for SEA-LEA 
Account a blllty, the Maryland State Department of Education Is conducting 
a study of the component costs of educational accountability Implementa- 
tion. Since the area Is new and, therefore, undefined, a single form would 
be Inadequate to assess the activities of the various school systems. 
Accordingly, a structured Interview will be conducted based on the 
enclosed questionnaire. 

The questionnaire Is merely a guideline for obtaining Information 
about various accountability activities. It Is being sent to you prior 
to the Interview so that you may have an opportunity to consult with 
co-workers and obtain data that may not be at your Immediate disposal. 
In reading each question, keep In mind personnel and cost figures at 
the level of Involvement In the defined areas of your school system. 

We realize that many of your responses will Involve approximations 
of your school system's Involvement; we are also Interested In obtaining 
measures of this dimension of accountability. Estimates of the accuracy 
of your estimated conmltments to each activity will be requested. 

Dr. William Griffith and his assistants will be contacting you 

shortly to schedule an Interview. If you have any questions Ir the 

Interim, please feel free to call Dr. Mclntyre at 796*8300, extension 

208, or Dr. Griffith on extension 326. 



Sincerely yours, 




JAMBS A. SENSENBAUGH 



State Superintendent of Schools 



JAS:G:dw 
Enclosure 
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APPENDIX B 



SUPPLEMENTARY REPORT TO ACCOUNTABILITY COMPONENT #1 and #2 
Goal and Objective Development and Implementation 

MSDE Priority Accountability Subject Areas of Concentration 

Chapter I, Section D, of the Maryland State Department of Education Handbook (1973-74) on the 
Accountability Assessment Program presents an accurate statement of its priority accountability 
subject areas of concentration. It states: 

In response to the accountability legislation enacted by the Maryland State Legislature and 
in accord with the six characteristics formulated for the States' Accountability Program, the 
Maryland State Board of Education determined that the initial efforts of accountability 
should concentrate on the basic learning skills of reading, writing, and mathematics. 
Following the specification of desired educational goals in each of these three areas, an 
accountability system should measure student achievement relative to each goal and then 
prepare an analysis of achievement results related to other variables, such as intelligence 
and socioeconomic status. 

MSDE Statewide Goals In Reading. Writing and Mathematics 

In June, 1 973, a statement about statewide goals in reading , writing, and mathematics for students in 
the public school system was published by MSDE. The following goals were identified: 

1. Goals In Reading. Each Marylar 1 student who has achieved the objectives for Reading 
established by the local school should: 

a. Utilize a variety of reading materials 

b. Use a word recognition system 

c. Comprehend various reading materials 

d. Meet the reading demands for functioning in society 

e. Select reading as a personal activity 

2. Goals in Writing. Each Maryland student who has achieved the objectives for Writing 
established by the local schools should: 

a. Use the writing process to communicate personal feelings and ideas, observing 
accepted conventions of writing 

b. Use the writing process to respond to the demands and obligations of society, 
observing accepted conventions in writing 

c. Value writing for personal and social reasons 

3. Goals In Mathematics. Each Maryland student who has achieved the objectives for 
Mathematics established by the local school should: 

a. Re:all and/or recognize mathematical definitions, facts, and symbols 

b. Perform mathematical manipulations 

c. Understand mathematical concepts and processes 

d. S'^lve specific mathematical problems 

e. Use mathematical reasoning and proce.«5ses to meet personal and societal needs 

f. Appreciate and use mathematics 
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Having identified both the MSDE priority areas and their goals, we now can examine the results of 
the supplementary data collected for this study as it reflects the emphasis of these three priority areas 
during the 1972-73 academic school year. It should be noted prior to the analysis of this data that the 
Maryland State Department of Education and the local educational agencies, because of the mandates 
of the Educational Accountability Act, are in a period of transition with regard to accountability and 
that the findings are likely to reflect this condition. 

LEA Responses to Major Subject Areas of Concentration for 1972-1973 and the Accountability 
Components 

Having already identified the MSDE priority accountability subject areas of concentration, the 
present investigation sought answers to the question, **What are the majorsubject areas of concentra- 
tion most directly involved in each of the accountability components as cost estimates for develop- 
ment and implementation were made for the 1972-1973 academic school year?" 

The subject areas of concentration identified in this study are reading, language arts, mathematics, 
science, social studies, vocational education, community service, and communications. Respondents 
were asked in the questionnaire to identify those subject areas of concentration they felt absorbed 
most of the funds related to the accountability components. In the next section, the results from the 
data collected on LEA Perspective on Priority Subject Areas of Concentration are presented. 

Results 

Tables B.I through B.3 show accountability subject areas of concentration fostered by small-, 
medium-, and large-sized school systems. The rows labeled "Total" provide a numerical breakdown of 
particular subject area(s) of concentration checked as most directly related to costs for the account- 
ability components development and implementation. 

For small-sized school systems (Table 8.1), the subject areas of concentration identified, from 
highest to lowest frequency, were: (1) reading; (2) vocational education and community services; (3) 
mathematics and communications; and (4) language arts, social studies, and science. 



TABLE 8.1 

Projected Major Subject Areas of Concentration for 1972-1973 Associated with Accountability 

Component #2 - Objective Deve opment and Implementation 
(School System Enrollment: less than 10.000 students) 











Area of Concentration 
























Voca- 








Small 












tional 




Com- 


School 


Size En- 




Language 






Social 


Educa- 


Community 


munica- 


System 


rollment 


Reading 


Arts 


Math 


Science 


Sutdies 


tion 


Service 


tions 


Kent 


3.926 


X 


X 


X 






X 




X 


Somerset 


4.629 


X 










X 


X 




Queen Anne s 


4.771 


X 




X 


X 










Talbot 


5.038 


X 










X 






Calvert 


6.117 


X 












X 




Dorchester 


6.467 


X 












X 




Worcester 


6.607 


X 








X 


X 


X 


X 




Total 


7 


1 


2 


1 


1 


4 


4 


2 
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For the medium-sized school systems (Table B.2). the subject areas of concentration identified, 
from highest to lowest ^-equency, were: (1) reading; (2) vocational education, (3) mathematics; (4) 
language arts; (5) comnr. mity services; (6) social studies; (7) science; and (8) communication. 



TABLE 8.2 

Projected Major Subject Areas of Concentration for 1972-1973 Associated with Accountability 



Component #2 - Objective Development and Implementation 
(School System Enrollment: between 10,000 & 50,000 students) 











Area of Concentration 






















Voca- 








Medium 












tional 




Com- 


School 


Size 




Language 






Social 


Educa- 


Community 


munica- 


System 


Enrollment 


Reading 


Arts 


Math 


Science 


Sutdies 


tion 


Service 


tions 


St. Mary's 


11,856 


X 










X 






Cecil 


12,378 


K 




X 












Charles 


14.437 


X 










X 


X 




Carroll 


17,213 


X 


X 


X 












Allegany 


17,589 


X 


X 


X 




X 


X 






Howard 


19.049 


X 


X 


X 












Washington 


24,053 


X 


X 






X 


X 


X 


X 


Harford 


31,620 


X 


X 


X 


X 




X 


X 






Total 


8 


5 


5 


1 


2 


5 


3 


1 



In the large-sized school systems (Table B.3), the subject areas of concentration identified, from 
highest to lowest frequency, were: (1) reading; (2) language arts, social studies, vocational education, 
and science; (3) mathematics; and (4) community services. 



TABLE 8.3 

Projected Major Subject Areas of Concentration for 1972-1973 Associated w*!*i Accountability 

Component #2 - Objective Development and Implementation 
(School System Enrollment: over 50.000 students) 



SchoOi 
System 



Large Size 
Enrollment 



Reading 



Language 
Arts 



Area of Concentration 



Math 



Science 



Social 
Sutdies 



Voca- 
tional Com- 
Educa- Community munica- 
tion Service tions 



Anne Arundel 
Montgomery 
Baltimore 
Prince George s 
Baltimore City 



75.452 
126.679 
134.136 
162.650 
190.735 



Total 



Total-Total 



20 



12 



37 



An examination of the row labeled "Total-Total" in Table B. 3 shows that the most frequently checked 
subject areas of concentration for the combined small-, medium-, and large-sized school systems 
were reading and vocational education, followed in order by language arts and mathematics, 
community services, and social studies. The least frequently checked subject areas were science and 
communications. This information shows that, for reading, the subject areas of concentration and 
present practices are in agreement. For mathematics, the level of agreement also is high. For writing, 
the situation is not as clear. If writing is equivalent to language arts, the agreement is high; if it is 
equivalent to communication skills, it is low. If writing means demonstrating actual skill, then neither 
the tests presently being used, nor the proposed one. measure this ability except in a secondary way 
(see Appendix C. Supplementary Report to Accountability Component Costs #3 - Status Surveying, 
for clarification of this point). On the writing factor, teacher judgment might be used effectively. 

Vocational education was identified as second by the small-, medium-, and large-sized school 
systems but has not been selected as a priority subject area of concentration by the Maryland State 
Departmant of Education. 

Sample Work Sheets 

In order to provide guidelines for establishing the costs associated with accountability components 
Goal and Objective Development and Implementation, sample work sheets have been provided on 
pages 39. 40. and 46. Such work sheets can be adjusted and used at the state and/or local levels. 
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APPENDIX C 



A SUPPLEMENTARY REPORT TO ACCOUNTABILITY COMPONENT COSTS #3 - 



Status Surveying 



This supplementary report Identifies some of the underlying dimensions in the Accountability 
Component Costs #3 - Status Surveying. The following items are discussed: (1) the Maryland LEA 
School Systems Testing Practices for the 1 972-73 academic school year; (2) the testing materials, test 
scoring, and per-pupil costs associated with Component #3 for different size school systems, and (3) 
the Maryland state plan for implementation of the accountability law. These items indicate a concern 
for providing the reader with information about testing activities at the state and local level and the 
costs associated with such activities for small-, medium-, and large-sized school systems. 

LEA School Systems Testing Practices (1972-1973) 

In Tables C.1 through C.3, 23 of 24 LEA school systems are examined in terms of their testing 
oractices during the 1972-1973 school years. 

The school systems again are broken down into small, medium, and large sizes. The examination 
covers the instruments used to assess student achievement, intelligence, and aptitude. The following 
tests were identified: 

ITBS - Iowa Test of Basic Sk lls 
ITED - Iowa Test of Educational Development 
MAT - Metropolitan Achievement Test 
TAP - Tests of Academic Progress 
STEP - Sequential Tests of Educational Progress 
SAT - Stanford Achievement Test Battery 
CAT - Cognitive Abilities Test 
L-T - Lorge-Thorndike Intelligence Tests 
0-L - Otis-Lennon Mental Ability Tests 
DAT - Differential Aptitude Tests 
GATB - General Aptitude Test Battery 

TABLE C.I 

Checklist of Achievement. Intelligence and Aptitude Tests Used by School Systems 
(School System Enrollment: less than 10.000 students) 



Types of Tests 

SmaW Achievement Intelligence Aptitude 

Size 

School 

System ITBS ITED MAT TAP STEP SAT CAT L-T 0-L DAT GATB 



Kent 

Somerset 

Queen Annes 

Talbot 

Calvert 

Dorchester 

Worcester 



Total 



41 

ERLC 



TABLE C.2 

Checklist of Achievement. Intelligence and Aptitude Tests Used by School Systems 
(School System Enrollment: between 10.000 & 50.000 students) 



Types of Tests 



MCQIUm 
















Size 




Achievement 




Intelligence 




Aptitude 


School 
















System 


ITSB ITED 


MAT 


TAP 


STEP SAT 


CAT L-T 


O-L 


DAT GATB 


Qt MAri/'c 


X • 


X 










X 


Cecil 


X 




X 




X 






O Korlofi 
V^ildrloS 


X 




X 


X 


X 


X 


X 


Carroll 


X 






X 








Allegany 


X 




X 




X 






Howard 


X 


X 






X 




- 


Washington 


X X 








X 






MarTora 




X 








X 


X 


Total 


6 2 


3 


3 


1 1 


2 3 


2 


3 0 










TABLE C.3 










Checklist of Achievement. Intelligence and Aptitude Tests Used by School Systems 








(School System Enrollment; over 50.000 students) 














Types of Tests 








Large 
















Size 




Achievement 




Intelligence 




Aptitude 


School 
















Systems 


ITBS ITED 


MAT 


TAP 


STEP SAT 


CAT L-T 


O-L 


DAT GATB 


Anne Arundel 


X 




X 




X 




X 


Montgomery 


X 










X 




Baltimore 


X 














Prince George s 


X 


X 












Baltimore City 


X X 


X 












Total 


5 1 


2 


1 


0 0 


1 0 


1 


0 1 


Total-Total 


15 6 


9 


5 


1 2 


4 4 


3 


5 1 



In these same tables, note that Mary land does not have a uniform statewide testing program. The 
number and type of tests used vary among school systems. In brief, Table C.3 provides an overview of 
the tests used by the Maryland school system. In this Table, the column labeled 'Total-Total" shows 
that 15 of 20 school' systems reported the use of the Iowa Tests of Basic Skills (ITBS). This was 
followed in their respective order by Metropolitan Achievement Test (MAT); the Iowa Test of 
Educational Development (ITED); the Test of Academic Progress (TAP); the Stanford Achievement 
Test Battery (SAT); and the Sequential Test of Educational Progress (STEP). 

Also in Table C.3. in the column labeled "Intelligence.*' fourof 20 school systems used the Cognitive 
Ability Test (CAT), and four used the Lorge-Thorndike Intelligence Test (L-T). Three of the 20 school 
systems used the Otis-Lennon Mental Ability Test (O-L). 

Of the two aptitude tests identified, six of 20 schools reported the use of the Differential Aptitude 
Test<: iOAT.) Only one school system reported the use of the General Aptitude Test Battery (GATB). 
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Testing Materials, Test Scoring, and Per-Pupll Costs Associated With Accountability Component #3- 
Status Surveying 

This analysis compared the costs of two elements of Accountability Component #3 - Status 
Surveying, testing materials and test scoring. Per-pupil costs associated with these two elements are 
identified for small-, medium-, and large-sized school systems. 

Small-Sized School System Testing Program Costs 

Six of nine small-sized systems provided data for the analysis. Table C.4 presents data on both 
"Testing Material Costs" and "Test Scoring Co&ts." 



TABLE C.4 

Estimated Testing Program Cost for Status Survey Component 



(School System Enrollment: less than 10,000 students) 







Testing Program Costs 






Per- Pupil Costs 








Testing 


Test 










School 


Small 


Materials 


Scoring 


Total 


Testing 


Test 


Total 


System 


Enrollment 


Costs 


Costs 


Btidget 


Materials 


Scoring 


Budget 


Kent 


3.926 


$ 2,500 


$2,500 


$ 5,000 


$ .64 


$ .64 


$1.27 


Talbot 


5.038 


7,500 


3,500 


11.000 


1.49 


.69 


2.18 


Caroline 


5,346 


2.000 


1,400 


3,400 


.37 


.26 


.64 


Calvert 


6.117 


7,580 


7,580 


15,160 


1.24 


1.24 


2.48 


Dorchester 


6.467 


1.852 


1.852 


3.704 


.29 


.29 


.57 


Worcester 


6.607 


10,000 


2,000 


12,000 


1.51 


. 30 


1.82 


Average' 


5,584 


$ 5,239 


$3,139 


$ 8,377 


$ .94 


$ .56 


$1.50 



NR - not reported 

'Average is of those systems reporting 



Considerable variability is found both between and within the columns of figures. In the column 
identified as "Total Budget" combined costs for these elements ranged from a low of $3,400 to a high of 
$15,160. The average cost figure for all six school systems was $8,377. 

The variability in costs is accounted for partially by the fact that some small school systems incurred 
greater cost than others for the purchase of new testing materials for their students, while others who 
had the testing materials on hand listed their principal expenditure as test scoring. 

An examination of the per-pupil cost related to testing materials and test scoring in Table C.4 
provides the following results: Per-pupil costs related to the purchase of testing materials tended to be 
higher in most cases than that of per-pupil costs related to test scoring. The cost related to both the 
testing materials and test scoring elements was $1.50. 

Medium-Sized School Systems 

Eight of ten medium-sized school systenr.s which provided data for this analysis are identified in 
Table C.5. An examination of the "Testing Program Costs" column labeled "Total Budget" shows that 
costs ranged from $2,700 to $32,470. Total costs for all eight medium-sized school systems amounted 
to $161,297, with an average of $20,162. 

Per-pupil costs in Table C.5 ranged from $ .1 1 to $2.25, with an average per-pupil cost of $1.09. 
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TABLE C.5 

Estimated Testing Program Cost for Status Survey Component 



(School System Enrollment: between 10.000 & 50.000 students) 







Testing Program Costs 






Per- Pupil Costs 








Testing 


Test 










School 


Small 


Materials 


Scoring 


Total 


Testing 


Test 


Total 


System 


Enrollment 


Costs 


Costs 


Budget 


Materials 


Scoring 


Budget 


St. Mary's 


11,856 


$ 6,000 


$ 8.000 


$14,000 


$ .51 


$ .67 


$1.18 


Cecil 


12,378 


4.537 


4.537 


9,074 


.37 


.37 


.73 


Charles 


14.437 


16.235 


16.235 


32,470 


1.12 


1.12 


2.25 


Howard 


19.049 


11.000 


19.000 


30.000 


58 


1.00 


1.57 


Carroll 


17.213 


20.000 


6.000 


26,000 


1.16 


.35 


1.51 


Allegany 


17.589 


16.794 


8,259 


25,053 


.95 


.47 


1.42 


Wa'hington 


24.053 


1.350 


1,350 


2,700 


.06 


.06 


.11 


Harford 


31,620 


11.000 


11,000 


22.000 


.35 


.35 


.70 


Average' 


18.524 


10.865 


9.298 


20,162 


.59 


.50 


1.09 



'Average is of those systems reporting 



Large-Sized School Systems 

Four of the five large-sized school systems provided information for analysis. An examination of 
Table C.6 shows the range of testing program costs reported under the column labeled "Total Budget" 
ranged from $18,500 to $160,000. The total budget is $262,500. with an average testing program 
budget of $65,625. 

TABLE C.6 

Estimated Testing Program Cost for Status Survey Component 



(School System Enrollment: over 50,000 students) 







Testing Program Costs 




Per-Pupil Costs 








Testing 


Test 










School 


Small 


Materials 


Scoring 


Total 


Testing 


Test 


Total 


System 


Enrollment 


Costs 


Costs 


Budget 


Materials 


Scoring 


Budget 


Anne Arundel 


75.452 


$ 7,000 


$11,500 


$ 18.500 


$.09 


$.15 


$.25 


Montgomery 


126.679 


36,000 


14.000 


50,000 


.28 


.11 


.39 


Baltimore 


134.136 


17.000 


17.000 


34.000 


.13 


.13 


.25 


Baltimore City 


190.735 


80,000 


80,000 


160,000 


.42 


.42 


84 


Average* 


131.751 


$35,000 


$30,625 


$ 65,625 


$.27 


$.23 


$.50 



'Average is of those systems reporting 



An examination of Table C.6 shows that, for the four schoc! systems considered, per-pupil costs 
ranged from $ .25 to $ .84, with an average per-pupil cusi of $ ,50. 

Summary 

Large-sized school systems incur lower per-pupil costs for both test materials and test scoring than 
either small- or medium-sized school systems. There appears to bean inverse relationship between 
the size of the school system and per-pupil costs. 
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MSDE Plan for the Implementation of the Accountability Law 

In June of 1973. the State Advisory Council suggested to the State Board of Education three interim 
recommendations: 

1 . The use of locally based assessment system? focusing on the degree to which a school 
is successful in meeting its own goals 

2. The use of a statewide testing and reporting program to be developed by the Maryland 
State Department of Education to measure the attainment of statewide goals 

3. The use of Iowa Tests of Basic Skills - 1971 edition, which measures only a portion of 
the goals, as part of the initial statewiue testing program 

Later that year the local coordinators, the Advisory Council, and the State Board of Education 
agreed that all school systems would administer the !owa Test of Basic Skills (1971 Edition, Form 3) 
and the Cognitive Ability Test (1971 Editior:, Form 1;. The testing program is to be coordinated by the 
Division of Research, Evaluation, and Information Systems of the State Department of Education. 

Accountability AssoMment Inttrumentt The eight sub-tests of the Iowa Tests of Basic Skills (ITBS) 
have been selected for use in grades 3, 5, 7, and 9. These sub-tests measure reading, mathematics, and 
writing. A major reason for selecting the ITBS is that this test is favorably reviewed in the Buros' Mental 
Measurement Yearbook and is highly rated with regard to content coverageand statistical character- 
istics by the UCLA's Center for the Study of Evaluation. Also important is the fact that the ITBS can 
provide criterion-referenced as well as norm-referenced information for instructional program 
analysis. The Cognitive Abilities Test (CAT) also is used to measure scholastic aptitude. Both the ITBS 
and CAT are developed and published by the same company (Houghton-Mifflin) and are normed by 
the same population. As such, the State purchased both tests for the local educational agencies. 

Data Collection and Procotting The classroom teachers are expected to administer the tests from 
March 1 to May 1 5. The local school districts and test publishers are to score the tests for the first year. 

« 

DIasemlnatlon The State Department of Education plans to prepare state, school system, and school 
summaries of test results. These summaries will be disseminated to the Governor, Legislature, 
newspapers, the State Board of Education, school systems, schools, teacher organizations, colleges, 
and universities. The reports also will be available within the Department for use by thegeneral public. 

Future 

The elements likely to change in the future are funding, areas assessed, tests, and data processing 
procedures. 

Sample Work Sheet 

To provide a guideline for establishing the accountability custs associated with Accountability 
Component Status Surveying, a sample work sheet has been provided. The work sheet can be adjusted 
to fit both the state and local levels. 
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ERIC 



APPENDIX D 
CHECKLIST 1 - PLANNING 



Educational Components Cost of Accountability Program (ECCAP) Active les 

* Review state accountability laws 

* Determine the accountability components covered in the state accountability laws 

* Determine the cost-pricing problem(s) related to the accountability components 

* Determine accountability component cost-pricing objectives and outcomes 

* Design an SEA-LEA cost-pricing model that reflects the statewide educational structure and 
situation 

* Plan a systems approach to the accountability component cost-pricing problem 

* Determine inputs into the system 

* Determine cost-pricing questions and categories 

* Develop accountability component cost instrument prototypes 

* Determine processes involved in the system 

" Determine strategies for pilot testing and refining prototype instruments 
' Specify details related to pilot testing 

* Determine strategies for field testing and further refining instruments on a selected 
sample of school systems throughout the state 

* Construct a plan for implementation of the cost instruments In all school systems of the state 

* Determine the administrative structure at the SEA-LEA levels that will be responsible for 
implementing the Educational Components Cost of Accountability Program (ECCAP) 

' Construct task analysis of SEA-LEA personnel responsibilities 

* Construct guidelines of responsibility for SEA-LEA officials and support personnel 

* Determine orientation and training procedures for SEA-LEA ECCAP personnel 

* Determine the accounting and reporting system for the accountability component cost 
information at each school system level considered 

* Determine procedures for a series of checkpoints to determine if cost information has been 
reported accurately 

* Determine the monitoring activities of SEA-LEA officials 

* Determine strategies for processing cost information 
" Determine data "analysis strategies 

* Determine the number of SEA-LEA man hours to implement the project 

* Determine the time schedules for the project 

* Determine general reporting policies to legislators, school systems, and the public 

* Construct a plan for the continuous evaluation of ECCAP 

* Determine the products from the system 

* State Level System: 
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* Identify the total, average, per-pupi I. and per-unit cost for the state on the educational goal 
component 

* Identify the total, average, per-pupil. and per-unit cost, as well as the number, of objectives 
developed and implemented 

* Identify the total, average, and per-pupil cost, as well as the number, of test materials 
purchased for the state on the educational status surveying of student achievement 
component 

* Local School Systems: 

* Identify the total, average, per-pupil. and per-unit cost for the educational goal, objective, 
and status sur/eying of student achievement components for each individual school system 
of the state 

* Identify the total cost of the accountability components at the elementary school level 

* Identify the total cost of the accountability components at the middle school level 

* Identify the total cost of the accountability components at the junior high school level 

* Identify the total cost of the accountability components at the senior high school level 

* Submit report to SEA 

* Submit report to Governor and State Legislators 

CHECKLIST 2 - IMPLEMENTATION 

Educational Components Cost of Accountabiiity Program (ECCAP) Activities 

* Organizing for accountability component cost program implementation 

* Prepare policy statement on management support and participation of SEA-LEA professional 
staff members 

* Assign organizational responsibilities for the ECCAP implementation and operation 

* Revise ECCAP implementation where necessary 

* Prepare procedures handbook for ECCAP implementation 

* Conduct ECCAP orientation and training of SEA-LEA professional staff members 

* Distribute handbook on ECCAP 

* Provide background and rationale for the Program 
' Preparation for the Program 

' Conditions for the ECCAP 

* System, school, and department responsibilities 

* Prepare SEA-LEA evaluators for implementation (i.e., first year of Program and use outside 
agents for future evaluators) 

* Educational Components Cost of Accountability Program operational considerations 
' System-level ECCAP responsibilities 

* Appoint system ECCAP cost coordinator and alternate (appointment by Superintendent) 

* Procure the accountability cost instruments 
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' Assign central staff at SEA-LEA levels to the cost program as coordinators, trainers, and 
supervisors 

* Distribute accountability component cost instruments and directions to school principals 

* Provide appropriate orientation and training for school ECCAP coordinators and cost 
administrators 

* Carry out a program of supervision to insure that ECCAP guidelines are being followed 

* Provide systematic procedures for collection of accountability components cost information 
' Prepare and transmit cost results to SEA-LEA 

* School-level ECCAP responsibilities 

* Designate ECCAP school coordinator and alternate (appointment by the Principal) 

* Handling, packaging, storing, sending ECCAP materials to local school system central office 
and on to state educational agency 

* Department chairperson orientation for the ECCAP 

* School-level cost supervision 

' Department/Content-area ECCAP responsibilities 

* Become familiar with ECCAP guidelines 

* Participate in appropriate orientation and training activities coordinated by the school 
and/or system ECCAP cost coordinator 

* Receive, distribute, compute, collect, and return accountability component cost instruments 
Carry out data collection, processing, analyzing, and reporting activities 

Carry out evaluation activities at state and local levels 
Carry out auditing activitie<^ t state and local levels 
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CAP PUBLICATIONS 

Report 
Number 

1 Annotated Bibliography of the State Educational Accountability Repository. 
Phyllis Hawthorne. Revised April 1974. Wisconsin. 

2 Legislation by the States: Accountability and Assessment in Education. Phyllis 
Hawthorne. Revised August 1974. Wisconsin. 

4 State Goals for Elementary and Secondary Education. Susan Ketchum Ribble. 
Revised September 1973. Wisconsin. ERIC ED 083747. 

5 Characteristics of and Proposed Models for State Accountability Legislation. 
Phyllis Hawthorne and Archie A. Buchmiller. April 1973. Wisconsin. ERIC ED 
078 514 

6 Accountability: A Bibliography. Gordon P. Hanson. July 1973. Wisconsin. 
ERIC ED 084630. 

20 Keeping the Public Informed: Accent on Accountability. A digest of the 
Michigan dissemination model. Erwin P. Bettinghaus and Gerald R. Miller. 
1973. Michigan. 

21 A Dissemination System for State Accountability Programs. Erwin P. 
Bettinghaus and Gerald R. Miller. June 1973. Michigan. 

22 Developing a Large Scale Assessment Program. Frank B. Womer. July 1973. 
Minnesota. 

23 Indicators and Statewide Assessment. March 1974. Oregon. 

24 Roles of the Participants in Educational Accountability. Carl E. Wilsey and 
Glenn B. Schroeder. 1974. Colorado. 

25 Using Educational Indicators for Program Accountability. Michael J. Grady. Jr. 
September 1974. Colorado. 

26. Costs of Educational Accountability: A Maryland Exploratory Study. 
November 1974. Maryland. 



NOTE Documents with ERIC reference numbers can be obtained through the usual ERIC 
procedures 



Copies may be obtained from: 

STATE EDUCATIONAL ACCOUNTABILITY REPOSITORY 
WISCONSIN DEPARTMENT OF PUBLIC INSTRUCTION 
126 LANGDON STREET 
MADISON, WISCONSIN 53702 




